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PATH DETERMINATION PROCEDURE 

('start) 

^40 



QOS 



INPUT: 
/ - ORIGIN 
; = DESTINATION 
€ = CONNECTION REQUEST 
P T - LENGTH THRESHOLD 
= QUALITY OF SERVICE PARAMETERS 



(S) Method and apparatus for optinum path selection in packet transmission networks. 

(57) A packet communications system utilizes a 
route determining mechanism by identifying 
principal paths between the source and the 
destination in the system. Principal paths are 
minimum hop count paths with a transmission 
delay less than a specified threshold. Principal 
path links are accepted as legs of the optimum 
path, if feasible, i.e., if the resulting load on the 
link is less than a specified principal threshold. 
Secondary links are accepted only if the result- 
ing load on the link is less than a specified 
secondary threshold, where the secondary 
threshold is less than the principal threshold. 
All paths must also have a transmission delay 
less than a specified threshold. Each request for 
a route includes the source node, the desti- 
nation node, the load required, the maximum 
transmission delay and, if desired, the quality of 
service parameters which all of the legs of the 
route must satisfy. A modified Bellman-Ford 
breadth-first search algorithm is used to identify 
the principal links and, using these principal 
link identifications, determining the optimum 
path. 
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PHASE 0: 

PRUNE ALL UNKS THAT CAN'T SUPPORT INPUT 
CONNECTION REQUEST BASED ON c AND QOS PARAMETERS 



PHASE I: 

MARK REMAINING LINKS AS PRINCIPAL OR SECONDARY 
(ASSUME CURRENT UTILIZATION IS ZERO WHEN 
DETERMINING THE LENGTH OF A LINK.) 
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PHASE U: 

COMPUTE THE PATH USING CURRENT UTILIZATION 
INFORMATION AND INFORMATION FROM PHASE I. 

THE ONLY INFORMATION KEPT FROM PHASE I 
IS WHETHER A UNK IS PRINCIPAL OR SECONDARY. 
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OUTPUT: 

AN ACCEPTABLE MINIMUM HOP PATH 
FROM / TOy WITH LENGTH LESS THAN P r 
OR 4 IF NO SUCH PATH EXISTS 




^45 



END 



Jouve, 18, rue Saint-Denis, 75001 PARIS 



EP 0 568 477 A2 

Technical Field 

This invention relates to packet transmission systems and, more particularly, to optimum path selection 
for connections between two nodes in such systems. 

5 

Background of the Invention 

It has become increasingly useful to interconnect a plurality of data processing elements by means of a 
packet switching network in which data is transmitted as data assemblages called "packets." Such networks 

10 include a plurality of interconnected network switching nodes which, in turn, are connected to end nodes sup- 
porting the data processing equipment. Such packet networks can become quite large with an extensive geo- 
graphical distribution. In such a situation, the selection of an efficient path between two end nodes which wish 
to communicate with each other becomes of paramount importance. 

The major criteria for selecting paths between nodes in packet networks are minimum hop count and mini- 

15 mum path length. The hop count is the number of links used to construct the path between the two end nodes. 
The path length is a function of the overall transmission delay imposed by the path between the two end nodes. 
In most high speed networks, the delay (path length) is not a major consideration since the worst-case delay 
through such networks is nearly always acceptable. The hop count however, is a direct measure of the amount 
of resources required to implement a given path and hence is of considerable importance in selecting paths. 

20 It is to be noted that a selected path need not be a minimum hop count path since congestion on the net- 
work links may force the choice of a larger hop count path. However, such longer alternate paths cannot be 
allowed to grow without limit since inordinate amounts of network resources might be committed to the one 
path, resulting in further congestion for other paths and forcing yet longer hop count paths to be selected for 
yet other connections. The long term network throughput could thereby be adversely affected. 

25 The problem, then, is to select a path between an origin node and a destination node which has a minimum 
hop count, a minimum path length, and which does not utilize an inordinate amount of network resources. 

Summary of the Invention 

30 In accordance with the illustrative embodiment of the present invention, optimum paths between origin 

and destination nodes in a packet network are selected by a modification of the so-called "Bellman-Ford al- 
gorithm," a shortest path on a weighted graph algorithm taught by D. P. Bertsekas in Dynamic Programming: 
Deterministic and Stochastic Models, pages 318-322, Prentice- Hall, 1987, Englewood Cliffs, New Jersey, and 
D. P. Bertsekas and R. Gallager in Data Networks, pages 315-332, Prentice-Hall, 1987, Englewood Cliffs, New 

35 Jersey. More particularly, the algorithm of the present invention defines "principal paths" between any given 
origin-destination pair. A principal path is defined as a feasible minimum-hop count path and principal links are 
defined as links in a principal path. All other links are defined as secondary links. Secondary paths are paths 
including at least one secondary link and including more than the minimum-hop count. 

A principal path is accepted as a route if none of its principal links is saturated, i.e., exceeds its preassigned 

40 traffic load. A secondary path, however, is accepted as a route only if none of its principal links, if any, is satu- 
rated and if the load levels on its secondary links are below a preselected threshold (typically lower than that 
for links designated as principal). If this load threshold is exceeded on any of the secondary links, the sec- 
ondary path is rejected as a route. 

One advantage of the path selection technique of the present invention is that a maximum path length 

45 constraint can be imposed on the path selection process. That is, feasible paths can be tested to determine 
if the path length constraint has been exceeded and rejected if the constraint is exceeded. Such constraints 
can be used to prohibit inordinate resource consumption in implementing a route and can also be used to im- 
pose specific grade of service requirements such as avoidance of low speed links. For this reason, the path 
length constraints must typically be specified for each connection request, and the principal links determined 

50 separately for each connection request. 

In summary, the route selection technique of the present invention involves two phases. In the first phase, 
the principal links are identified for the requested connection. If no maximum length constraint is imposed, the 
principal links between any two nodes of the network can be precomputed and stored for use in the second 
phase of the algorithm. If a maximum length constraint is imposed, the principal links must be calculated for 

55 each new connection request, comparing each link length with the constraint, or the constraint decreased by 
the previously accepted principal link lengths. 

The route determination technique of the present invention has the advantages of producing optimum 
paths between arbitrary nodes of a packet switching system, taking into account not only the hop count and 
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the path length, but also Imposing a maximum ceiling on the path length. In addition, the computation of op- 
timum paths is sufficiently rapid that a path computation can be made for each request for a connection. 

5 Brief Description of the Drawings 

A complete understanding of the present invention may be gained by considering the following detailed 
description in conjunction with the accompanying drawings, in which: 

FIG. 1 shows a general block diagram of a packet communications network in which the route determt- 
10 nation system of the present invention might find use; 

FIG. 2 shows a graphical representation of the header of a data packet which might be transmitted on the 
packet communications network of FIG. 1; 

FIG. 3 shows a block diagram of a typical decision point at the entry point for packets entering the network 
of FIG. 1; 

15 FIG. 4 shows in tabular form a portion of the topology data base in each decision point such as that shown 
in FIG. 3 and which is used to calculate optimum paths; 

FIG. 5 shows a general flow chart of the path computation procedure of the present invention; 
FIG. 6 shows a more detailed flow chart of Phase I of the procedure of FIG. 4; 
FIG. 7 show a more detailed flow chart of Phase II of the procedure of FIG. 4; 
20 FIG. 8 is a yet more detailed flow chart of Routine A of the Phase I portion of the procedure of FIG. 5; 

FIG. 9 is a yet more detailed flow chart of Routine B of the Phase I portion of the procedure of FIG. 5; and 
FIG. 1 0 is a detailed flow chart of the search algorithm used in Routine A of FIG. 8. 
To facilitate reader understanding, identical reference numerals are used to designate elements common 
to the figures. 

25 

Detailed Description 

Referring more particularly to FIG. 1, there is shown a general block diagram of a packet transmission 
system 10 comprising eight network nodes 11 numbered 1 through 8. Each of network nodes 11 is linked to 

30 others of the network nodes 11 by one or more communication links A through L. Each such communication 
. link may be either a permanent connection or a selectively enabled (dial-up) connection. Any or all of network 
nodes 11 may be attached to end nodes, network node 2 being shown as attached to end nodes 1, 2 and 3, 
network node 7 being shown as attached to end nodes 4, 5 and 6, and network node 8 being shown as attached 
to end nodes 7, 8 and 9. Network nodes 11 each comprise a data processing system which provides data com- 

35 munications services to all connected nodes, network nodes and end nodes, as well as decision points with 
the node. The network nodes 1 1 each comprise one or more decision points within the node, at which incoming 
data packets are selectively routed on one or more of the outgoing communication links terminated within that 
node or at another node. Such routing decisions are made in response to information in the header of the data 
packet. The network node also provides ancillary services such as the calculation of routes or paths between 

40 terminal nodes, and providing directory services and maintenance of network topology data bases used to 
support route calculations. 

Each of end nodes 12 comprises either a source of digital data to be transmitted to another end node, a 
utilization device for consuming digital data received from another end node, or both. Users of the packet com- 
munications network 10 of FIG. 1 utilize an end node device 12 connected to the local network node 11 for 

45 access to the packet network 1 0. The local network node 11 translates the user's data into packets formatted 
appropriately for transmission on the packet network of FIG. 1 and generates the header which is used to route 
the packets through the network 10. The header has the general form shown in FIG. 2 and includes control 
fields 20, a routing field 22 and a redundancy check byte 23. The routing field 22 contains the information nec- 
essary to route the packet through the packet network 10 to the destination end node 12 to which it is ad- 

so dressed. 

In FIG. 3 there is shown a general block diagram of a typical packet network decision point such as is 
found in the network nodes 11 of FIG. 1. The decision point of FIG. 3 comprises a high speed packet switching 
fabric 33 onto which packets arriving at the decision point are entered. Such packets arrive over transmission 

links via transmission adapters 34, 35 36, or originate in user applications in end nodes via application adap- 

55 ters 30, 31 32. It should be noted that one or more of the transmission adapters 34-36 can be connected 

to intranode transmission links connected to yet other packet switching fabrics similar to fabric 33, thereby ex- 
panding the switching capacity of the node. The decision point of FIG. 3 thus serves to connect the packets 
arriving at the decision point to a local user (for end nodes) or to a transmission link leaving the decision point 
(for network nodes and end nodes). The adapters 30-32 and 34-36 may include queuing circuits for queuing 
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packets prior to or subsequent to switching on fabric 33. A route controller 37 is used to calculate optimum routes 
through the network for packets originating at the decision point of FIG. 3. A topology data base 38 contains 
information about all of the nodes and transmission links of the network of FIG. 1 which information is used 

5 by controller 37 to calculate optimum paths. 

The route controller 37 of FIG. 3 may comprise discrete digital circuitry or may preferably comprise properly 
programmed digital computer circuits. Such a programmed computer can be used to generate headers for pack- 
ets originating at user applications in the decision point of FIG. 3 or connected directly thereto. The information 
in data base 38 is updated when new links are activated, new nodes are added to the network, when links or 

10 nodes are dropped from the network or when link loads change significantly. Such information originates at 
the network node to which the resources are attached and is exchanged with all other nodes to assure up-to- 
date topological information needed for route calculation. Such data can be carried on packets very similar to 
the information packets exchanged between end users of the network. 

The incoming transmission links to the packet decision point of FIG. 3 may comprise links from local end 

15 nodes such as end nodes 12 of FIG. 1 , or links from adjacent network nodes 11 of FIG. 1. In any case, the 
decision point of FIG. 3 operates in the same fashion to receive each data packet and forward it on to another 
local or remote decision point as dictated by the information in the packet header. The packet network of FIG. 
1 thus operates to enable communication between any two end nodes of FIG, 1 without dedicating any trans- 
mission or node facilities to that communication path except for the duration of a single packet. In this way, 

20 the utilization of the communication facilities of the packet network is optimized to carry significantly more traf- 
fic than would be possible with dedicated transmission links for each communication path. 

In FIG. 4 there is shown in tabular form a portion of the information stored in the data base 38 of FIG. 3. 
As can be seen in FIG. 4, a number of different characteristics of each link in the network is stored in the data 
base. For the purposes of the present invention, only a few of these characteristics will be discussed. As might 

25 be expected, one of the critical characteristics of the transmission links is the load threshold available on that 
(ink. Moreover, it is well known that such transmission facilities can only be loaded up to a fraction of their the- 
oretical maximum load if reasonable transmission properties are to be maintained. The load threshold of such 
a transmission facility can be represented by the quantity Cm, the effective load capability of the transmission 
link between nodes k and I. For reasons to be discussed hereinafter, two different load thresholds are defined 

30 for each transmission links, depending on whether the link is selected as a principal link in a route or as a sec- 
ondary link in the route. A principal link is defined as a leg of a principal path where a principal path is a feasible 
minimum hop count path between the originating node and the destination node. The hop count is simply the 
number of transmission links in the path. All other links are defined to be secondary links. Any non-minimum 
hop count path between the originating node and the destination node is called a secondary path and it always 

35 includes at least one secondary link. In accordance with the present invention, a principal path is preferred 
over a secondary path in determining optimum routes between nodes. If, however, a principal path is not avail- 
able due to its already being fully loaded, a secondary path can be chosen. In order to discriminate against 
such a secondary path, a load threshold is defined for each secondary link which is less than the correspond- 
ing principal load threshold for that same link. Thus the table of FIG. 4 includes two different load thresholds 

40 for each transmission link, one to be used if the link is a principal link in a route being calculated and the other 
to be used in the link if a secondary link in the route being calculated. 

Also shown in the table of FIG. 4 is the Total Allocated Load, T(AL), for each link. This value represents 
the total load which has already been allocated for this transmission link due to previously calculated routes. 
If the difference between this already allocated load and the total available principal or secondary load of the 

45 channel (depending on the whether the link is a principal link or a secondary link) is not sufficient to carry the 
new connection, then the link cannot be selected. In accordance with the present invention, in addition a path 
can be selected only if the overall path delay does not exceed a maximum delay defined as P T . In order to 
calculate the incremental delay introduced by this link, dw, the following formula can be used, using the values 
show in the table of FIG. 4: 

50 d _ 

W ~ (C w - U w O>)(C w - U w (2» 

where 

C w = Total Bandwidth of Transmission Link from Node k to 1, 
= C W , P (FIG. 4) if the link is a principal link, or 
55 =C Wf8 (FIG. 4) if the link is a secondary link, 

C M < 1 > = Allocated Bandwidth Before This Connection, and 
C w < 2 > = Allocated Bandwidth After This Connection. 

To support the calculation of equation (1), the topology data base 38 contains, for each link, not only the load 
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threshold (e.g., C titP and Ch.s), but also the currently allocated load for each transmission link (e.g., Cw). The 
definition of the incremental delay given in equation (1) is for illustration purposes only and many other for- 
mulations can be used. This incremental delay is subtracted from the maximum delay to produce a new max- 

5 imum delay available for future links in the selected route. 

In addition to the bandwidth information discussed above, the topological data base 38 of FIG. 3 and illu- 
strated in FIG. 4 includes so-called "Quality Of Service (QOS)° parameters. Such QOS parameters can be spe- 
cified in a particular request for an optimum route and the present invention operates to insure that all of the 
selected links in the path conform to the requested QOS parameters. Such QOS parameters may include, for 

10 example, a particular security level, a maximum propagation delay or a minimum probability of buffer overflow. 
In accordance with the present invention, the total amount of delay permitted for each route has the finite 
limit P T . This limit is imposed to avoid excessive delay and to prevent the dedication of an undue amount of 
resources to any one connection. Without such a limitation, it is possible to create an unstable condition where 
the resources of the packet communications system are rapidly used up in increasingly more complex long 

15 paths. That is, the use of excessive amounts of resources for one route leaves less resources available for 
other routes, requiring even greater resources for future routes. 

If no limitation is put on the maximum delay permitted for each route, it is possible to calculate all principal 
paths and principal links between any two nodes ahead of time and merely access them from a stored table 
when the route determination is done. In order to accommodate a finite limitation on path delay, however, it 

20 is necessary to determine the principal paths, and hence the principal links, for each new route request. 

In accordance with the present invention, each request for a route determination includes the following 
input parameters: 
. Origin Node (i) 
. Destination Node (j) 

25 . Required Bandwidth (c) 

. . Maximum Path Length Threshold (P T ) 

. Quality of Service Parameters (QOS), Optional) 
Using these parameters, a path is determined by first searching through all links to determine minimum hop 
count path that satisfy the maximum path length constraint P T and then backtracking to derive a list of principal 

30 links. This search is supplemented by accumulating the link delays for each path. Once the destination node 
is reached, minimum hop count principal paths are backtracked to create a list of principal links. This principal 
link list is used in the second phase of the algorithm to determine the optimum path from the source to the 
destination node. This specific procedure for determining paths through a packet communications system will 
be described with reference to the balance of the figures. 

35 In FIG. 5, there is shown a general flow chart of the path computation procedure of the present invention. 

Starting at start box 40, input box 41 is entered to specify the inputs required to calculate an optimum route 
in accordance with the present invention. As noted above, these input parameters include the originating node 
i, the destination node j, the requested connection bandwidth c, the maximum path length P T and, optionally, 
a group of "quality of service" parameters QOS. With these inputs, box 42 is entered where, as Phase 0, the 

40 list of links in the network is pruned by removing all links which do not meet the QOS parameters. With this 
decimated list of transmission links, Phase I box 43 is entered to identify the principal links. In determinating 
the lengths of the transmission links in this process, it is assumed that the utilization of each link is zero (C w 
= 0), i.e., the entire bandwidth of the link is available. The process used to search the network for principal 
paths is a modification of the so-called Bellman-Ford algorithm described at pages 318-322 of Dynamic Pro- 

45 gramming: Deterministic and Stochastic Models, by D. P. Bertsekas, Prentice-Hall, 1987, Englewood Cliffs, 
New Jersey. This algorithm will be described in detail hereinafter. 

Once the principal paths have been identified in box 43, Phase II box 44 is entered where the optimum 
path isidentif ied, using the principal paths from box 43, and using the current utilization data (allocated band- 
width C w ). As noted in box 45, the outputfrom box 44 is an acceptable minimum hop count path from the orig- 

50 inating node i to the destination node j which has the minimum possible hop count and which path length is 
less than the input maximum of P T . If no such path exists, an failure signal U is returned. The process ends 
in terminal box 46. 

In FIG. 6 there is shown a more detailed flow chart of Phase I of the flow chart of FIG. 5 in which the links 
of the packet communications system of FIG. 1 are marked as principal or secondary for this particular request. 
55 As noted, in box 51 Routine A utilizes a modified Bellman-Ford algorithm to search all of the links between 
the origin and the destination nodes, keeping track of the hop count and the path length increment for each 
link. Once the destination node is reached, box 52 is entered where Routine B backtracks through the links 
to discover the paths with both a minimum hop count and a length that satisfies the maximum path length 
constraint P T . These paths are principal paths and all of the links in these paths are principal links. All other 
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links are secondary links. Only the information as to whether the link is principal or secondary is retained for 
use in Phase II of the procedure. 

In FIG. 7 there is shown a more detailed flow chart of Phase II of the flow chart of FIG. 5 in which the 

5 optimum path is computed. Starting in start box 60, box 61 is entered where Routine A, essentially identical 
to Routine A In FIG. 6, uses the same modified Bellman-Ford algorithm to determine the feasibility and the 
link length for each possible link in the ultimate path. Primary links are accepted as feasible providing only 
that load capacity is available for the new connection, i.e., C w (2) does not exceed the principal link load thresh- 
old C M|P . Secondary links are accepted as feasible provided that adding the new connection does not result 

10 in are accepted as feasible only if the incremental increase in path length caused by the link does not increase 
the total path length so that it is greater than the specified maximum path length P T . In box 62, the list of fea- 
sible links are backtracked through using the hop count and the path lengths to find the shortest path with 
the minimum hop count. The process of FIG. 7 ends in terminal box 63. 

In FIG. 8 there is shown a more detailed flow chart of Routine A used in FIGS. 6 and 7. When used in FIG. 

15 6 to identify the principal links, the flow chart of FIG. 8 starts in box 70 from which box 71 is entered where a 
breadth-first exhaustive search is made, starting at the origin node i. That is, each link from each node is fol- 
lowed to the next node where each link is again followed to the next node, and so forth. For each node k en- 
countered in this search, the minimum hop count (hk) from the origin node to node k is saved along with the 
length (Ih) of the shortest path from the origin to node k only if the length is less than P T . When the destination 

20 node is reached in this search, in box 72, the hop count h f is the minimum hop count from i to j such that the 
shortest path length is less than P T . If no such path exists, box 73 returns a null value of 0. Routine A then 
terminates in box 74. 

In FIG. 9 there is shown a more detailed flow chart of Routine B used in FIGS. 6 and 7. When used in FIG. 
6 to identify principal links, the flow chart of FIG. 9 starts In box 80 from which box 81 is entered. In box 81, 

25 the path is retraced from the destination node j to the origin node i. Links are marked as principal in this back- 
tracking if the link belongs to a path with minimum hop count and length less than P T . In box 82, links which 
are not principal are marked as secondary. Box 83 terminates the process. 

Returning to FIG. 8, when Routine A is used to calculate the optimum path. The actual utilizations of the 
links are used to determine whether the links are feasible and the link length. When routine A is completed, a 

30 path has been identified with the minimum feasible hop (i.e., a hop count equal to or greater than the minimum 
hop count h f ) and with a length less than P T In FIG. 9, the hop count and minimum lengths associated with 
each node are used to identify the actual optimum path. 

In FIG. 10 there is shown a detailed flow chart of the modified Bellman-Ford algorithm used to perform 
the search for an optimum path. In FIG. 10, starting at box 90, box 91 is entered to set the next node to the 

35 origin node i. In box 92, the data for the next node is retrieved from the topology data base 38 of FIG 3. In box 
93, the data for the next link leaving that node is obtained from the data base. In decision box 94 it is determined 
whether or not thatjink is a principal link. If the link is a principal link, decision box 95 is entered where the 
accumulated load C w (2) is compared to the link principal threshold C W(P . If the accumulated load is equal to or 
less than the principal threshold, box 97 is entered to calculate the incremental delay in accordance with equa- 

40 tion (1). If the accumulated load is greater than the principal threshold, as determined by decision box 95, the 
next link is obtained in box 100. 

If it is determined indecision box 94 that the link is a secondary link, decision box 96 is entered to compare 
the accumulated load C M (2) to the link secondary threshold C W|S . If the accumulated load is equal to or less 
than the secondary threshold, box 97 is entered to calculate the incremental delay in accordance with equation 

45 (1). If the accumulated load is greater than the secondary threshold, as determined by decision box 96, the 
next link is obtained in box 100. 

In decision box 98, the accumulated path length up to this point is compared to the maximum path length 
P T . If the accumulated path length is less than P T , the hop count hk and the accumulated path length d w are 
save in a list in box 99. If the accumulated path length is equal to or greater than P T , box 99 is bypassed and 

so the data for this link is not added to the list. In either case, decision box 100 is then entered to determine if 
there are any more links exiting from this node. If so, box 93 is entered to get the next link and continue the 
process. If there are no more links exiting from this node, decision box 101 is entered to determine if the node 
is the destination node j. If so, the process is complete and terminates in stop box 102. If this node is not the 
destination node j, box 92 is entered to get the next node and continue the process. 

55 When the procedure of FIG. 10 is complete, a list of the minimum hop counts hk and the path lengths d w 
is available. As discussed above, Routine B then backtracks through this list to identify the path with the mini- 
mum path delay as well as the minimum hop count. This is the optimum path to be used in sending the packets 
involved in the connection through the system of FIG. 1 . 

When used to identify the principal paths, the flow chart of FIG. 10 is modified to omit the decision box 
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94. Using the principal load threshold of each link, the minimum hop count and the length of the path to each 
node encountered is kept on the list. This list can then be processed by backtracking to identify the principal 
paths (having both minimum hop counts and lengths less than PT). The links of the principal path are the prin- 
cipal links to be used in computing the optimum transmission route. The entire procedure for computing prin- 
cipal links and optimum routes is described in the pseudocode in the attached Appendix. The correspondence 
between the pseudocode and the flow charts of FIGS. 5 through 10 is obvious and will not be described in 
detail here. 

It should also be clear to those skilled in the art that further embodiments of the present invention may 
be made by those skilled in the art without departing from the teachings of the present invention. 

APPENDIX 
Minimum Path Algorithm 

The algorithm to be described for computing the 
best possible path with the minimum possible hop count 
assumes the availability of a set of all of the principal 
links between the origin node and the destination node. 
This principal link list can be precomputed by assuming 
that the minimum path length is infinity (P T = or can 

be computed, as will be described, by utilizing the same 
algorithm in a phase preceding the path computation phase. 
Definitions : 

. i is the index of the origin node. 
. j is the index of destination node. 



N is the total number of nodes in the network. 
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. h is the step number of the algorithm, equal to the hop 
count . 

. P T is the maximum path length between origin and desti- 
nation nodes, 

. h f is the minimum hop count of a selected path of length 
less than P T (if suph a path exists). 

* d kl is the len ^ th of the lin k (if any) between nodes k 
and 1 

. Di(l,h) is the length of the shortest path between nodes 
i and j of exactly h hops Di(l,h) = « if no such path 
exists) . 

Di(l,h) can be represented by a (sparse) two-dimensional 
array, with indices l,h = 0, 1, ... , N-l. 

. A(k,l) is a function that is equal to "1" if the link is 
acceptable, and "0" otherwise. This function depends on 
whether the link kl is principal or not. 

Note that both of the functions A(k,l) and d kl 
depend upon the connection request. 

The following pseudocode is used to both identi- 
fy principal links and to compute the best acceptable 
path. This algorithm is first described to compute the 
best acceptable path, assuming that the principal links 
have already been identified. Thereafter, it will be 
shown how this same algorithm can be used to identify all 
of the principal links. The inputs to the algorithm are a 
connection request, the index i of the origin node, the 
index j of the destination node (i *j), and the path 
length acceptance threshold P T> The algorithm will pro- 
duce an acceptable minimum hop path from i to j with mini- 
mum length less than P T/ if such a path exists. If no 
such path exists, the algorithm returns a value of 0. 
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Best Path Pseudocode 

/* Initialization */ 

for (h = 0; h < N; h++) 
{ 

for (1 = 0; 1 < N; 1++) 
{ 

Di(l,h)=~; 

I 

} 

Di(i,0) = 0; 

20 

/* Determine Shortest Path From Origin to Destination */ 
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= 0 ; /»-- Initialize Final Hop Count to 0 

for (h = 0; h < N; h++) 
{ 

for (1 = 0; 1 < N; 1++) 
{ 



30 



35 



40 



50 



Shortest Path From i to I in (h+1) Hops 



for (k = 0; k < N; k++) 

{ 

if (A(k,l) = 1) then 
{ 

Di(l, h+1) = 

min[Di(l,h+l) ,Di(k,h)+ d kl ] 

45 } 
1 

} 



if (Di(j,h+1) < P T ) then 



/* Found a Path Within the Threshold P^* 



55 
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h f = h 
break; 



h+1; 



if (h- = 0) then Return 0 



/* 



No Path 



/* 



Retrace Selected Shortest Path From Destination to Origin 



*/ 



Path = j; 



* = j; 

for (h = h f -l; h > 0; h— ) 
[ 

for (1 = 0; 1 < 0; 1++) 

{ 

if (A(l / k) = 1 and Di(k, h+1) = Di(l,h) + dlk) then 



} 

} 

) 

Path = i,Path; 
Return Path; 

COMMENT: It is assumed that either a single predecessor 
exists, or the first predecessor is picked when more than 
one exists. A preferred alternative is to construct a 
list of all possible predecessors and select one predeces- 
sor from the list by a random process. 



Path = l,Path; 
k = 1; 

break; /•- 



See Comment Below 



Principal Link Identification 
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If the connection request specifies a finite 
length of the acceptance threshold P T , then the first step 
must be to determine the principal links associated with 
this request for a new network connection. The above- 
described algorithm is used with the following modifica- 
tions: 

. A new acceptance function A'(k,l) only checks for links 
that cannot accomodate the new connection since princi- 
pal links are not yet known and a special load threshold 
for non-principal links is meaningless. 

. The weight of the link k 1 (without considering existing 
existing network traffics) is given by d' kl . 



It is assumed that A(k,l) < A ! (k,l) and that 0 < d' R1 < 



d kl 



Retracing the path from the destination to the origin 
can be omitted. 



. Computation of d ! kl and A'(k,l) assumes that the incom- 
35 ing connection is the only one on the link. This elimi- 

nates link that are either not capable of carrying the 
connection, or are part of a path whose length can 
never be lower than P„ 



T* 



. The output of this algorithm includes not only the hop 
count h f and the path length Di( j,h f ) of the best fea- 
sible path between the origin and the destination, but 
also the length of all lower hop count paths to possible 
transit nodes. This information is used to identify 
50 principal links. 

In general, principal links are identified by 

55 
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backtracking from the destination node j, breadth-first 
and by decreasing the hop count, all computed paths satis- 
fying the length constraint P T « More particularly, 

1. Starting with destination j, inspect all adjacent 
nodes 1 that are one hop away to determine if they 
satisfy Di(l,h f -1) + d'^ < P ? . 

2. For each node 1 satisfying (1), mark the link lj a 
principal and define a new length threshold 

P T (1) = P T - d'jj. By convention, it is assumed 
that P T (j) = P T . 

3. After inspecting all adjacent nodes, decrement the 
hop count by 1 (h = h f - 1). 

4. Inspect all nodes k that are two hops away from 
destination node j . 

5. Mark all links kl as principal if Dk(k,h--2) + d' 
is less than P T (1). 

6. Define a new length threshold for node k such that 

p T (k) = p t (d - d ' kl . 

7. Repeat steps (1) through (6) until the hop count is 
equal to zero. At this time, all principal links 
have been identified. 

Principal Link Identification Pseudocode 

/* Initialization */ 

Principal = 0 for (1=0; 1<N; 1++) 
{ 

P T (D = 0 
j P T (j) = P T 
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/* Decrement Hop Count */ 

for (h = h f ; h>0; h--) 

I 

PrinLinks = { } ;/* Initialize the Principal Link List to an empty 

list'*/ 



for (1=0; 1<N; 

15 I 

for (k=0; k<N; k++) 
{ 

if (A^k.l) = 1) then 
{ 



if (Di(k,h-1) + d kl < P T (1)) then 
[ 

PrinLinks = PrinLinks U f(k,l)} 
) 

} 



} 



} 

Principal = Principal U PrinLinks; 



/* Now update the accumulated delay maxima P^ */ 



for (k,l) in PrinLinks 
{ 

P T (k) = max[ P T (k), P T (1) - d' kl ] ; 

} 

} 

return Principal; 



50 Claims 

1 . A packet communications system comprising 

a first plurality of packet switching nodes (1 1) for receiving and sending data packets in said system (10), 
a second larger plurality of transmission links (A,L) interconnecting pairs of said packet switching nodes 
55 (11), 

means for determining optimum routes between a packet originating node (i) in said system (10) and a 
packet destination node (j) in said system (10), said means for determining optimum routes characterized 
in that they comprise (FIG. 5) : 
- means for identifying principal paths including minimal hop count and minimal transmission delay be- 
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low a preselected threshold (P T ) between said originating node (i) and said utilizing node (j) (43), 

- means utilizing said principal path identifications for determining an optimal path between said orig- 
inating (i) and destination (j) nodes (44), and 

- means for limiting the transmission delay in said optimal path to a preselected threshold (45). 

2. The packet communications system (10) according to claim 1 wherein said means for determining optimal 
paths comprises a modified Bellman-Ford algorithm (FIG. 8). 

3. The packet transmission system (1 0) according to claim 1 wherein said means for limiting the transmission 
delay comprises 

means for weighing each said tranmission link in accordance with a weighing function dependent on the 
non-allocated bandwidth available in the corresponding one of said transmission links. 

4. The packet transmission system (1 0) according to claim 3 wherein said means utilizing said principal path 
identifications comprises means for providing a larger effective bandwidth for links when in said principal 
paths than for links when not in said principal paths. 

5. The packet transmission system (10) according to claim 1 wherein said means for limiting the transmission 
delay comprises 

means for weighing each said transmission link according to the equation (FIG. 10) : 

d - Cw 

where 

d w is the incremental delay between nodes k and 1, 
C H = total bandwidth of said transmission link from Node k to I, 
C w (1) = already allocated bandwidth before this route, and 
C w (2) = allocated bandwidth after this route. 

6. A route controller (37) for a packet communications system (10) comprising packet switching nodes (11) 
interconnected by transmission links (A, L) characterized in that it comprises (FIG. 5) : 

means for identifying principal paths including minimal hop count and minimal transmission delay below 
a predetermined threshold P T between an originating node (i) and a destination (j) in said system (10) 
(43), 

means, responsive to said means for identifying principal paths, for determining an optimal path between 
said originating (i) and destination (j) nodes (44), and 

means for limiting the transmission delay in said optimal path to a preselected threshold (45). 

7. The route controller (37) according to claim 6 wherein 

said means for identifying principal paths comprises a modified Bellman-Ford algorithm (FIG. 6). 

8. The route controller (37) according to claim 6 wherein said means for limiting the transmission delay com- 
prises 

means for weighing each said tranmission link in accordance with a weighing function dependent on the 
non-allocated bandwidth available in the corresponding one of said transmission links. 

9. The route controller (37) according to claim 8 wherein said means responsive to said means for identifying 
principal paths comprises means for specifying a larger effective bandwidth for links when in said principal 
paths than for links when not in said principal paths. 

10. The route controller (37) according to claim 6 wherein said means for limiting the transmission delay com- 
prises 

means for weighing each said transmission link according to the equation (FIG. 10) : 

d 

" (Cm - Cki< 1 0(C w - U w (2>) 

where 

d w is the incremental delay between nodes k and I, 
C w = total bandwidth of said transmission link from Node k to I, 
C M (1) = already allocated bandwidth before this route, and 
C w (2) = allocated bandwidth after this route. 
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11. Amethod (FIG. 6) for determining routes in a packet communications system characterized in that it com- 
prises the step of 

interconnecting a first plurality of packet switching nodes (11) for receiving and sending data packets in 
5 said system (10) with a second larger plurality of transmission links (A, L), 

identifying principal paths including both a minimal hop count and a minimal transmission delay below a 
predetermined threshold (P T ) between an originating node (i) and a destination node (j) in said system 
(43), 

utilizing said principal path tdentif ications for determining an optimal path between said originating (i) and 
10 destination (j) nodes (44), and 

limiting the transmission delay in said optimal path to a preselected threshold (45). 

12. The method according to claim 11 wherein said step of identifying principal paths (43) utilizes a modified 
Bellman-Ford algorithm (FIG. 6). 
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13. The method according to claim 11 wherein said step of limiting the transmission delay comprises the step 
of 

weighing each said tranmission link in accordance with a weighing function dependent on the non-allo- 
cated bandwidth available in the corresponding one of said transmission links. 

14. The method according to claim 13 wherein said step of utilizing said principal path identifications com- 
prises the step of 

specifying a larger effective bandwidth for links when in said principal paths than for links when not in 
said principal paths. 

15. The method according to claim 11 wherein said step of limiting the transmission delay comprises the step 
of 

weighing each said transmission link according to the equation (FIG. 10) : 



d w = 



35 



(C w - U^XCh - U w (2>) 
where 

d w is the incremental delay between nodes k and 1, 
Cy = total bandwidth of said transmission link from Node k to I, 
C w (1) = already allocated bandwidth before this route, and 
C w (2) = allocated bandwidth after this route. 
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FIG. 3 
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FIG. 5 

PATH DETERMINATION PROCEDURE 



(start) 



INPUT: 
i = ORIGIN 
j = DESTINATION 
c = CONNECTION REQUEST 
P T = LENGTH THRESHOLD 
QOS - QUALITY OF SERVICE PARAMETERS 
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PHASE 0: 

PRUNE ALL LINKS THAT CAN'T SUPPORT INPUT 
CONNECTION REQUEST BASED ON c AND QOS PARAMETERS 
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PHASE I: 

MARK REMAINING LINKS AS PRINCIPAL OR SECONDARY 
(ASSUME CURRENT UTILIZATION IS ZERO WHEN 
DETERMINING THE LENGTH OF A LINK.) 
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PHASE II: 

COMPUTE THE PATH USING CURRENT UTILIZATION 
INFORMATION AND INFORMATION FROM PHASE I. 

THE ONLY INFORMATION KEPT FROM PHASE I 
IS WHETHER A LINK IS PRINCIPAL OR SECONDARY. 
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OUTPUT: 

AN ACCEPTABLE MINIMUM HOP PATH 
FROM i TO; WITH LENGTH LESS THAN P T 
OR <J> IF NO SUCH PATH EXISTS 
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FIG. 6 

PHASE I 

MARK LINKS AS PRINCIPAL OR SECONDARY 



(start) 



ROUTINE A: 
MODIFIED BELLMAN-FORD ALGORITHM 
WITH 

LENGTH, HOP COUNT AND MAXIMUM LENGTH CONSTRAINTS 



ROUTINE B: 
BACKTRACK, 
MARKING ALL PRINCIPAL LINKS 
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FIG. 7 

PHASE II 
DETERMINE OPTIMUM PATH 
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ROUTINE A: 

MODIFIED BELLMAN-FORD ALGORITHM USING 
PRINCIPAL/SECONDARY AND LINK UTILIZATION CRITERIA 
TO DETERMINE PATH LENGTH AND FEASIBILITY 
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ROUTINE B: 
BACKTRACK, 
USING HOP COUNT AND LINK LENGTHS 
TO DETERMINE SHORTEST PATH 
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FIG. 8 

ROUTINE A 
MODIFIED BELLMAN-FORD ALGORITHM 



(start) 



USE BREADTH-FIRST SEARCH, 
STARTING AT ORIGIN i, 
TO DETERMINE, FOR EACH NODE k, THE TUPLE (h, IX WHERE 
h f - NUMBER OF HOPS FROM i TO k, AND 
l h = LENGTH OF SHORTEST PATH FROM i TO Jfc OF EXACTLY h HOPS 
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SUCH THAT THE SHORTEST LENGTH PATH 
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IF NO SUCH PATH EXISTS, 
RETURN 4> 
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ROUTINE B 
BACKTRACKING PROCEDURE 




RETRACE FROM j TO j 
AND MARK A LINK AS PRINCIPAL 
IF THE LINK BELONGS TO A PRINCIPAL PATH 
(A PATH OF /y HOPS FROM i TO; WITH LENGTH LESS THAN P T ) 
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IS SECONDARY 
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FIG. 10 

SEARCH ALGORITHM 
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FIG. 5 

PATH DETERMINATION PROCEDURE 
(START) 



INPUT: 
i o ORIGIN 
; «= DESTINATION 
c s CONNECTION REQUEST 
P- m LENGTH THRESHOLD 
QOS = QUALITY OF SERVICE PARAMETERS 



(&) Method and apparatus for optinum path selection in packet transmission networks. 

(5?) A packet communications system utilizes a 
route determining mechanism by identifying 
principal paths between the source and the 
destination in the system. Principal paths are 
minimum hop count paths with a transmission 
delay less than a specified threshold. Principal 
path links are accepted as legs of the optimum 
path, if feasible, i.e., if the resulting load on the 
link is less than a specified principal threshold. 
Secondary links are accepted only if the result- 
ing load on the link is less than a specified 
secondary threshold, where the secondary 
threshold is less than the principal threshold. 
All paths must also have a transmission delay 
less than a specified threshold. Each request for 
a route includes the source node, the desti- 
nation node, the load required, the maximum 
transmission delay and, if desired, the quality of 
service parameters which all of the legs of the 
route must satisfy. A modified Bellman-Ford 
breadth-first search algorithm is used to identify 
the principal links and, using these principal 
link identifications, determining the optimum 
path. 
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PHASE 0: 

PRUNE ALL LINKS THAT CANT SUPPORT INPUT 
CONNECTION REQUEST BASED ON e AND QOS PARAMETERS 
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PHASE I: 

MARK REMAINING LINKS AS PRINCIPAL OR SECONDARY 
(ASSUME CURRENT UTILIZATION IS ZERO WHEN 
DETERMINING THE LENGTH OF A LINK.) 
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PHASE m 

COMPUTE THE PATH USING CURRENT UTILIZATION 
INFORMATION AND INFORMATION FROM PHASE I. 

THE ONLY INFORMATION KEPT FROM PHASE I 
IS WHETHER A LINK IS PRINCIPAL OR SECONDARY. 
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OUTPUT: 

AN ACCEPTABLE MINIMUM HOP PATH 
FROM i TOy WITH LENGTH LESS THAN f> T 
OR 6 IF NO SUCH PATH EXISTS 
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